#15: Design of Interactive Multimodal Media Systems

Organizer
Kellogg Booth (The University of British Columbia)

Lecturers
Kellogg Booth (The University of British Columbia)
Sidney Fels (The University of British Columbia)
Brian Fisher (The University of British Columbia)
Karon Maclean (The University of British Columbia)
Ronald Rensink (The University of British Columbia)

Overview
How traditional human-computer-interaction methodologies augmented with theories and experimental findings from cognitive science address challenges posed by multimodal interaction using vision, haptics, and sound in conventional and immersive computer graphics environments. Attendees learn the theory and practice of multimodal interaction design in a multidisciplinary setting.

Prerequisites
This course is intended for people who are involved in the design of interactive media and applications for emerging computer display technologies. Attendees should be familiar with the basics of computer graphics and interactive media, but they do not need any particular technical background.

Topics
The cognitive science of intersensory processing (vision, hearing, haptics) in scene understanding and interaction, including attention, change blindness, haptics, ventriloquism, and space constancy. Enhanced iterative design (the reflective practitioner model) for integration of visual display design, haptic devices, and sonified and integrated visual-auditory environments including virtual environments and community or performance spaces.

Course #15 Notes (PDF, 5.5MB)